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Terminal  Report 

The  work  performed  under  this  contract  falls  into  two  periods.    Dur- 
ing the  first,  which  lasted  from  September,  1953,  through  August,   1954,  I  was  on 
the  staff  of  the  Institute  of  Mathematical  Sciences  of  New  York  University.    During 
the  second  period,  I  was  employed  by  the  American  Mathematical  Society  in  Provi- 
dence, Rhode  Island,  as  its  Executive  Director. 

The  two  main  lines  along  which  the  work  proceeded  were  (a)  numeri- 
cal analysis,  with  particular  reference  to  linear  computations,  (b)  statistical  infer- 
ence. In  the  Bibliography  attached  to  this  report,  items  1,  5,  and  6  are  in  field  (a) 
and  items  2,4,  and  7  are  in  field  (b).     The  two  fields  are  combined  in  item  3. 

Most  of  the  work  in  field  (b)  consisted  in  organizing  facts  already 
known  and  existing  in  scattered  forms  in  the  literature.    The  result  appears  in  item 
4,  "Lectures  on  the  Theory  of  Industrial  Sampling  ".    There  was  some  foregroimd 
research  work  done  in  this  field,  however.    The  results  exist  only  in  manuscript 
form,  but  are  summarized  in  item  7,  which  is  here  quoted  in  its  entirety: 

"First  it  is  proved  that  virtually  any  form  of  probability  sampling  without  re- 
placements from  a  lot  which  is  itself  a  random  sample,  yields  a  random  sample  from 
the  process      The  sample  and  the  uninspected  remainder  (u.  r. )  of  the  lot  will  be  dis- 
tributed independently.    It  is  shown  that  in  spite  of  this  independence  it  is  possible  to 
draw  inferences  from  sample  to  u.r.    Various  elementary  inequalities  linking  para- 
meters of  the  u.r.  to  those  of  the  lot  and  of  the  sample  are  derived.    For  the  normal 
case  and  attributes  case,  various  confidence  intervals  for  parameter  of  the  u.r.  are 
also  derived.    Then  conditional  inferences  into  over-all  lot  quality  are  considered. 
To  develop  this  point  of  view,  various  conditional  distributions  of  sample  statistics 
relative  to  h5rpotheses  on  the  corresponding  lot  statistics  are  derived  for  the  normal 
binomial,  Poisson  cases.    (E.g.  the  conditional  distribution  of  the  sample  variance 
for  fixed  lot  variance  is  in  the  normal  case  a  beta  distribution. )   Other  results  in- 
clude general  formulas  for  the  unconditional  distribution  of  the  sample  mean  in  sam- 
pling with  replacements,  and  for  conditional  mean  values  in  sampling  without  re- 
placements.   (Received  March  15,  1954.)" 
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All  of  the  work  in  field  (b)  was  accomplished  during  the  New  York 
University  period. 

In  the  case  of  field  (a),  some  of  the  work  consisted  in  reworking  and 
organizing  known  results,  and  some  of  it  consisted  in  original  research.     The  work 
in  this  field  continued  through  to  the  termination  of  the  contract.    It  was  interrupted 
during  the  last  few  months  of  the  extension  of  the  contract  by  the  necessity  of  per- 
forming an  operations  analysis  of  the  pricing  and  inventory  procedures  of  the  Ameri- 
can Mathematical  Society,  which  itself  is  expected  to  result  in  a  publication  in  the 
field  of  management  sciences. 

No  professional  salaries  have  been  charged  to  the  contract  since  Au- 
gust,1954. 

The  expository  work  in  field  (a)  is  represented  by  items  1  and  5  „    Item 
5  is  merely  the  first  chapter  of  a  rather  long  book  described  in  item  1.    A  complete 
hand-written  manuscript  of  this  book  was  in  existence  at  the  time  that  the  Providence 
period  of  this  report  began,  but  I  considered  the  treatise  to  be  unsatisfactory  for 
modern  purposes  because  it  did  not  deal  adequately  with  round- off  error. 

The  foreground  research  of  the  New  York  period  is  represented  in  i- 
tems  3  and  6,  which  have  been  widely  circulated  (probably  several  thousand  copies  of 
each  are  in  circulation  due  to  publication  and  demand  for  reprints).    Also,  each  item 
has  been  reviewed  in  Mathematical  Reviews  and  elsewhere  (a  review  of  item  3  ap- 
pears in  the  current  MTAC).    Therefore  no  summary  will  be  given  here. 

The  foreground  research  performed  in  field  (a)  has  been  done  in  Provi- 
dence, with  the  idea  of  equipping  the  book  with  a  good  account  of  round-off  error  in 
matrix  computations.     The  first  successful  treatment  is  in  two  papers  by  von  Neu- 
mann and  Gioldstine  in  the  Bulletin,  American  Mathematical  Society,  53:1021-1099, 
and  the  Proceedings,  American  Mathematical  Society,  2:188-202.    Numerous  prior 
and  later  unsuccessful  treatments  are  in  the  literature.    To  take  a  specific  case,  I 
feel  that  the  fairly  recent  paper  by  Lotkin  and  Remage,  supported  by  Army  Ordnance 
funds  (Ballistics  Research  Laboratories),  in  the  Annals  of  Mathematical  Statistics, 
24:428-439  (expanded  version  available  in  a  BRL  report),  which  deals  with  round-off 
error  In  the  case  of  the  Escalator  Method,  is  unsuccessful.     This  is  because  it  fails 
to  take  into  account  the  killing-off  of  round-off  error  in  the  computation  as  a  whole. 
It  may  be  that  nothing  better  can  be  done  for  the  Escalator  Method,  but  I  doubt  it. 
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The  only  successful  way  to  attack  the  round-off  error  problem  is  to  attack  it  globally, 
considering  the  entire  problem  as  a  whole, 

My  efforts  in  this  direction  centered  at  first  on  simplifying  the  von  Neu- 
mann-Goldstine  approach,  which  as  presented  in  the  first  reference  Is  complicated 
and  unsuitable  for  expository  treatment.    I  was  able  to  obtain  simply-derived  round- 
off estimates    slightly  sharper  than  theirs,  but  with  a  minor  side  conditicn  which  they 
did  not  employ. 

Furthermore     my  methods  are  applicable  to  the  round-off  problem  for 
linear  equations    which  they  do  not  handle,     I  was  also  able  to  obtain  direct  estimates 
for  a  non-symmetric  matrix    instead  of  having  to  refer  this  case  to  the  symmetric 
case  by  preconditioning    as  von  Neumann  and  Goldstine  do 

The  main  trick  which  1  use  may  be  described  roughJy  as  follows.     The 
basic  matrix  inversion  method  which  is  here  under  study  is  one  which  probably  should 
be  called  the  Cholesky-Crout  method      It  consists  in  factoring  the  matrix  A  inio  a 
product  LDU    where  L  is  a  lower  unit  triangle    D  is  a  diagonal  matrix,  and  U  is  an 
upper  unit  triangle.     Then  each  of  the  factors  are  in  effect  inverted  separately  (there 
are  several  variations  of  the  method  at.  this  point)  and  the  inverses  are  multiplied 
together  to  obtain  the  inverse  of  A      There  Is  no  difficulty  in  obtaining  easy  round- 
off estimates  for  the  last  half  of  the  procedure.    The  difficulty  arises  in  the  factoring 
of  A.    In  the  course  of  this,  it  is  necessary  to  perform  certain  divisions  by  the  ele- 
ments of  D.    The  device  which  I  found  useful  consisted  in  assuming  double-precision 
division  when  the  elements  of  D  are  thus  used. 

The  approach  reported  on  here  seems  to  avoid  the  repeated  applica- 
tion of  scale  factors  which  is  one  of  the  things  that  make  the  von  Neumann-Goldstine 
papers  so  complicated.    But  in  practice  with  an  automatic  computer,  it  may  be  nec- 
essary to  introduce  scale  factors  at  intermediate  points.    The  effect  of  this  on  my 
estimate  needs  to  be  examined.    Rather  extensive  further  research  work  is  called 
for  to  derive  round-off  error  estimates  for  the  various  other  methods  of  matrix 
inversion  listed  in  item  1  of  the  bibliography. 
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